European Middleware Initiative

EMI
Developer(s) EMI project
Stable release 1.0 / 12 May 2011
Operating system Scientific Linux 5 (32, 64bit)
Type Grid computing
License Multiple. Each product has its own. Most of them are Apache or BSD.
Website www.eu-emi.eu

The European Middleware Initiative (EMI) is a software platform for high performance distributed computing. It is distributed directly by the EMI project[1][2][3] which is behind its development, support and promotion and is also the base for other grid middleware distributions used by various scientific research communities and distributed computing infrastructures all over the world especially in Europe,[4] South America[5] and Asia.[6] EMI supports broad scientific experiments and initiatives, such as WLCG (the Worldwide LHC Computing Grid.) A cooperation with FutureGrid, a US distributed testbed for Clouds, Grids and HPC, was announced in December 2011.[7]

The EMI middleware is a cooperation among three general purpose grid platforms, ARC, gLite and UNICORE and a storage solution, dCache. Each platform is made of different products which provide services.[8]

Contents

Purpose

The purpose of the EMI distribution is to consolidate, harmonize and support the original software platforms, evolve and extend them based on existing and new requirements. Redundant or duplicate services resulting from the merging are deprecated, in favour of new services added to satisfy user requirements or specific consolidation needs, standardizing and developing common interfaces. These include the adoption of a common structure for accounting, resource information exchange or authentication/authorization.

Input for the development activities is taken from users, infrastructures projects, standardization initiatives or changing technological innovations. The software products will be adapted as necessary to comply with standard open source guidelines to facilitate the integration in mainstream operating system distributions.[9]

Users

Today the EMI project provides and maintains most of the middleware components which support the execution and completion of the millions of computational jobs handled by the 350 centers of the EGI infrastructure and the tens of petabytes of data transfers occurring between the storage systems of those centers.[10][11]

In particular the EMI middleware empowers the WLCG infrastructure which supports, for example, the search for the Higgs boson (the God Particle)[12] and new types of matter searches of the physicists at LHC together with other large scientific challenges in astronomy, biology, computational chemistry and other sciences.[13]

License

There is no common EMI license though all licenses used by EMI are open source. Each product having a long history behind adopted its own. Most are Apache or BSD.[14]

dCache products are released under the dCache Software License[15] but they will adopt the AGPL license from 1 January 2012.

Products

The first release of the software is composed of 56 products. They can be grouped in four categories (areas): computing, data, security and infrastructure.[16]

Releases

EMI releases are of two types: Major releases and Component Releases which involve a single product.[17]

Major Releases

Major releases are delivered once per year. There are three planned major releases, named after famous European mountains, to underline the increasing level of features in each release.

Release Name Release Date End of Support
1.0 Kebnekaise 2011-05-12 2013-04-30
2.0 Matterhorn 2012-04-30 2013-04-30
3.0 Monte Bianco 2013-02-28 2013-04-30

Component Releases

Minor Releases: contain interface or functional changes that are backwards-compatible with those of the current major release. They are issued a few times per year.

Revision Releases: available every week or two weeks. They contain only bug fixes.

Emergency Releases: contain only very specific bug fixes, typically security-related and are available as need, using emergency release procedures.

References

  1. ^ "Featured article: EMI, home to middleware". iSGTW. June 2010. http://www.isgtw.org/?pid=1002515. Retrieved 22 December 2011. 
  2. ^ "Presentation of the European Middleware Initiative project". GridCast. 16 September 2010. http://gridtalk-project.blogspot.com/2010/09/european-middleware-initiative.html. Retrieved 22 December 2011. 
  3. ^ "European Middleware Initiative project presentation". GridCafè. 2010. http://www.gridcafe.org/emi.html. Retrieved 22 December 2011. 
  4. ^ "The EGI Software Repository Portal". EGI. http://repository.egi.eu/. Retrieved 22 December 2011. 
  5. ^ "Iniciativa de Grid de America Latina-Caribe. Resource Center Reference". IGALC. http://www.igalc.org/rc_reference/rc_reference.html. Retrieved 25 December 2011. 
  6. ^ "Taiwan Grid Portal". TWGrid. http://www.twgrid.org/. Retrieved 26 December 2011. 
  7. ^ "EMI collaboration announcement. FutureGrid Portal". FutureGrid. https://portal.futuregrid.org/news/emi-collaboration-futuregrid. Retrieved 26 December 2011. 
  8. ^ "EMI web site home page". EMI. http://www.eu-emi.eu. Retrieved 22 December 2011. 
  9. ^ "EMI software releases introduction". EMI. http://www.eu-emi.eu/releases. Retrieved 22 December 2011. 
  10. ^ Vetterli, M. (2 July 2008). "ATLAS Computing: Dealing with Petabytes of Data per Year". High Performance Computing Systems and Applications, 2008. HPCS 2008. IEEE. p. 84. ISBN 978-0-7695-3250-9. ISSN 1550-5243. http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=4556078. Retrieved 23 December 2011. 
  11. ^ Jacqui Hayes (21 December 2011). "Happy 10th Birthday, WLCG!". isgtw. http://www.isgtw.org/feature/happy-10th-birthday-wlcg. Retrieved 23 December 2011. 
  12. ^ Leslie Versweyveld (13 September 2010). "WLCG working hard to make the Higgs particle theory come true". PRIMEUR. http://enterthegrid.com/primeur/10/articles/weekly/AE-PR-10-10-67.html. Retrieved 23 December 2011. 
  13. ^ "EMI services used in neuro-scientific grand challenge". isgtw. 3 October 2011. http://www.isgtw.org/announcement/emi-services-used-neuro-scientific-grand-challenge. Retrieved 23 December 2011. 
  14. ^ "EMI DNA2.4.2, Exploitation and Sustainability Plan, EU Deliverable: D2.4.2" (PDF). EMI. 30 April 2011. p. 13. http://cdsweb.cern.ch/record/1277605/files/EMI-D2.4.2-1277605-Exploitation_and_Sustainability_Plan_M12-v1.0.pdf. Retrieved 22 December 2011. 
  15. ^ "dCache Software License". dCache. http://www.dcache.org/manuals/dCacheSoftwareLicence.html. Retrieved 22 December 2011. 
  16. ^ "EMI Software products categories". EMI. http://www.eu-emi.eu/tech-areas. Retrieved 22 December 2011. 
  17. ^ "EMI Software Releases". EMI. http://www.eu-emi.eu/releases. Retrieved 22 December 2011. 

External links